ELECTRONIC CAMERA EXTRACTING A PREDETERMINED NUMBER OF 
IMAGES FROM A PLURALITY OF IMAGES GENERATED BY 
CONTINUOUS SHOOTING, AND METHOD FOR SAME 



CROSS REFERENCE TO RELA TED APPUCA VON 
This application is based upon and claims the benefit of priority from Japanese 
Patent Application No, 2003-036920, filed on February 14, 2003, the entire contents of 
which are incorporated herein by reference. 

BACKGROUND OF THE INVENTION 
/. Field of the Invention 
The present invention relates to an electronic camera having a continuous shooting 

mode. 

Z Description of the Related Art 

In general, an electronic camera has a single-shooting mode for shooting one 
frame when a shutter button is pressed and a continuous shooting mode, in the 
continuous shooting mode, a shooting operation is repeated while a shutter button is 
pressed to shoot a plurality of frames continuously. In addition to the ordinary 
continuous shooting mode, a multi-shooting mode is known as a type of continuous 
shooting mode. In the muiti-shooting mode, images in a plurality of shot frames are 
arranged and composited into one image (disclosed in Japanese Examined Patent 
Application Publication No. Hei 1 1-88824, for example). 

In the present specification, one image composited in the multi-shooting mode is 
simply referred to as composite image, and an image in one frame generated by continuous 
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shooting is simply referred to as single frame image. Image data of a composite image is 
simply referred to as composite image data, and image data of a single frame image is 
simply referred to as single frame image data. 

An electronic camera having the continuous shooting mode frequently employs an 
5 image sensor which can be switched between a motion image mode and a still image mode. 
Normally, the frame rate of an image sensor in the motion image mode is unique to the 
sensor such as 30 fps (frame per second), so that it is not possible to set arbitrary frame 
rate. 

Therefore, the shooting Interval (the interval at which frame images are shot) of a 

10 camera in the conventional multi-shooting mode is unique to the camera, and it is not 
possible to set the shooting interval arbitrarily in accordance with an expected moving 
speed of an object. In this case, a problem may arise that a composite image includes 
unnecessary frame images that are substantially the sarne as their respective preceding and 
succeeding frame images. 

1 5 If the shooting interval is fixed, total shooting time (from a time at which the first 

single frame of a composite image is shot to a time at which the last single frame image 
thereof is shot) is determined depending on how may frames are arranged in the composite 
image. With a fixed total shooting time, for example, when a swing of a golf club or a 
pitching motion of a baseball player is shot, it is not possible to make the beginning and 

20 end of the swing (or pitching) coincide with the beginning and end of the total shooting 
time. This may cause a problem that the composite image does not include all of the 
frame images of the swing because the shooting terminates before the swing completes. 
Also, there may be a similar problem that the composite image includes many unnecessary 
frame images which are taken after the swing because the swing completes before the 

25 shooting terminates. 



SUMMARY OF THE INVENTION 
It is an object of the invention to enables arbitrary setting of a total shooting time in 
a multi-shooting mode of an electronic camera. 
5 The electronic camera of the invention has a multi-shooting mode in which data of 

a predetermined number of images generated by continuous shooting is arranged and 
composited (combined) to generate data of a single composite image. Note that the 
predetermined number of images herein may be referred to as the number of frames which 
are arranged in a composite image (or the number of arranged frames). According to one 

1 0 aspect of the invention, an electronic camera has a release switch, an image pickup part, an 
extraction processing part, and an image composition part. The release switch is for 
instructing the execution of a shooting operation. When the electronic camera is in the 
multi-shooting mode, the image pickup part performs continuous shooting in accordance 
with an operation to the release switch to generate data of a plurality of images. The 

1 5 extraction processing part changes an extracting rate according to the number of the 
images generated by the image pickup part, and extracts data of the predetermined number 
of images from the generated data of the images according to the changed extracting rate. 
The image composition part arranges and composites the extracted data of the 
predetermined number of images to generate the data of the single composite data. 

20 The release switch may sometimes be referred to as release button. The image 

pickup part corresponds to, for example, a combination of a shooting lens, a CCD, an 
analog signal processing part, a timing generator, and a focusing motor. The extracting 
rate may sometimes be referred to as image extracting interval. The extraction processing 
part has a function of an MPU for determining the image extracting interval and extracting 

25 data of frame images according to the image extracting inten/al and a function of an MPU 



for calculating differences between frame images in data and extracting data of frame 
images in ascending order of the differences, for example. The image composition part 
has, for example, a function of an image processing part for generating composite image 
data using the extracted data of frame images. 

In the electronic camera as described above, it is preferred that the extraction 
processing part performs the extraction at such intervals that intervals at which images in 
extracted data have been shot become substantially uniform. 

In another aspect of the invention, an electronic camera has a release switch, an 
image pickup part, a variation calculating part, an extraction processing part, and an ihiage 
composition part. The release switch is for instructing the execution of a shooting 
operation. When the electronic camera Is in the multi-shooting mode, the image pickup 
part performs continuous shooting in accordance with an operation to the release switch to 
generate data of a plurality of images. The variation calculating part calculates a difference 
between frame images in the data generated by the image pickup part. The difference 
represents an amount of variation (movement) in an object. The extraction processing part 
extracts data of the predetermined number of images from the data of the plurality of 
images at such intervals that the smaller the differences between frame images, the longer 
the intervals. For example, the extraction may be performed such that data of frame 
images is extracted in ascending order of the differences between the frame images. The 
image composition part arranges and composites the extracted data of the images to 
generate the data of the single composite image. 

In the electronic camera as described above, the extraction processing part may 
preferably extract the data of the predetermined number of images in ascending order of 
the differences between the frame images. 

In another aspect of the invention, an electronic camera has a release switch, an 



image pickup part, a variation calculating part, an extraction processing part, and an image 
composition part. The release switch is for instructing the execution of a shooting 
operation. When the electronic camera is in the multi-shooting mode, the image pickup 
part performs continuous shooting according to an operation to the release switch to 
5 generate data of a plurality of images. The variation calculating part selects the data of the 
predetermined number or more of images from the generated data of the images according 
to the number of images generated by the image pickup part, and calculates a difference 
between frame images in the selected data. The difference represents an amount of 
variation in an object. The extraction processing part extracts the data of the 

1 0 predetermined number of images from the data of the plurality of images at such intervals 
that the smaller the difference between the frame images, the longer the intervals. The 
image composition part arranges and composites the extracted data of the images to 
generate the data of the single composite image. 

In another aspect of the invention, an electronic camera has a release switch, an 

1 5 image pickup part, an extraction processing part, and an image composition part. The 
release switch is for instructing the execution of a shooting operation. When the electronic 
camera is in the multi-shooting mode, the image pickup part performs continuous shooting 
according to an operation to the release switch to generate data of a plurality of images. In 
the multi-shooting mode the extraction processing part extracts the data of the 

20 predetermined number of images from the data of the plurality of images at such intervals 
that an Nth frame image data to be extracted is generated by shooting at a time of an Xth 
power of (N-1) where X is more than zero when a first frame image data to be extracted is 
assumed to be generated by shooting at a time zero. The image composition part arranges 
and composites the extracted data of the images to generate the data of the single 

25 composite image. 



In another aspect of the invention, an electronic camera has a release switch, an 
image pickup part, an extraction processing part, and an image composition part. When 
the electronic camera is in the multi-shooting mode, the release switch instructs start and 
end of continuous shooting. The image pickup part performs the continuous shooting 
5 according to an operation to the release switch to generate data of a plurality of images in 
the multi-shooting mode. The extraction processing part extracts data of the 
predetermined number of images from the data of a plurality of images in such a manner 
that the data extracted includes data of images shot at the start and end of the continuous 
shooting. The image composition part arranges and composites the extracted data of the 

1 0 predetermined number of images to generate the data of the single composite image. 

The electronic camera described above may be preferably configured that the 
extraction processing part changes an extracting rate according to the number of images 
generated by the image pickup part and extracts the data of the predetermined number of 
images from the generated data of the images according to the changed extracting rate. 

1 5 Alternatively, the electronic camera may be provided with a variation calculating 

part that calculates a difference between frame images in the data of the images generated 
by the image pickup part. The difference represents an amount of variation in an object. 
In this case the extraction processing part performs the data extraction such that the 
smaller the difference, the longer the intervals. 

20 The image generation method of the invention is for generating data of a single 

composite image by arranging and compositing data of a predetermined number of images 
generated by continuous shooting. In one aspect of the image generation method of the 
invention, the method includes the steps of: performing continuous shooting to generate 
data of a plurality of images; changing an extracting rate according to the number of 

25 images generated and extracting the data of the predetermined number of images; from the 



generated data of the images according to the changed extracting rate; and generating the 
data of the single composite image by arranging and compositing the extracted data of the 
images. 

In another aspect of the image generation method of the invention, the method 
5 includes the steps of: generating data of a plurality of images by continuous shooting; 
calculating a difference between frame images in the generated data, the difference 
representing an amount of variation in an object; extracting the data of the predetermined 
number of images from the generated data of the images at such intervals that the smaller 
the difference between the frame images, the longer the intervals; and generating the data 

10 of the single composite image by arranging and compositing the extracted data. 

In another aspect of the image generation method of the invention, the method 
includes the steps of: generating data of a plurality of images by continuous shooting; 
selecting data of the predetermined number or more of images from the generated data of 
the images according to the number of images generated, and calculating a difference 

1 5 between frame images in the selected data, the difference representing an amount of 
variation in an object; extracting data of the predetermined number of images from the 
generated data of the images at such intervals that the smaller the difference between the 
frame images, the longer the intervals; and generating the data of the single composite 
image by arranging and compositing the extracted data of the images. 

20 In another aspect of the image generation method of the invention, the method 

includes the steps of: generating data of a plurality of images by continuous shooting; 
extracting data of the predetermined number of images from the generated data of the 
images, the extraction being performed at such intervals that an Nth frame image data to be 
extracted is generated by shooting at a time of an Xth power of (N-1) where X is more than 

25 zero when a first frame of image data to be extracted is assumed to be generated by 



shooting at a time zero; and generating the data of the single composite image by 
arranging and compositing the extracted data of the images. 

In another aspect of the image generation method of the invention, the method 
includes the steps of: instructing start and end of continuous shooting; generating data of a 
plurality of images by the continuous shooting according to the instruction; extracting the 
data of the predetermined number of images from the data of the plurality of images in 
such a manner that the data extracted includes data of images shot at the start and end of 
the continuous shooting; and generating the data of the single composite image by 
arranging and compositing the extracted data of the images. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The nature, principle, and utility of the invention will become more apparent from 
the following detailed description when read in conjunction with the accompanying 
drawings in which like parts are designated by identical reference numbers and in which: 

Fig. 1 is a block diagram showing a configuration of an electronic camera according 
to an embodiment of the invention; 

Fig. 2 is a flow chart showing operations of the electronic camera of the 
embodiment; and 

Fig. 3 is an illustration showing an example of a composite image created in a 
multi-shooting mode. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 
Hereinafter, a description will be given of an embodiment of the invention with 
reference to the accompanying drawings. 
<Configuration of Embodiment> 
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Fig. 1 is a block diagram of an electronic camera of the present embodiment. As 
illustrated, an electronic camera 12 is constituted of a shooting lens 16, a CCD (image 
sensor) 20, an analog signal processing part 24, an analog-to-digital conversion part 28, a 
timing generator 32, a focusing motor 36, an MPU (Micro Processor Unit) 40, an operation 
5 part 44, a system bus 48, an image processing part 52, an image-data memory (RAM) 56, a 
program memory (ROM) 60, a card interface 64, a replaceable memory card (recording 
medium) 68. a USB (Universal Serial Bus) 72, a USB interface 76, a monitor control part 80, 
and an LCD(Liquid Crystal Display) 84. 

The analog signal processing part 24 and the analog-to-digital conversion part 28 
10 perform clamp processing, sensitivity correction processing, and analog-to-digital 
conversion to generate digital image data. 

The MPU 40 performs system control of the electronic camera 12. 

The operation part 44 has setting buttons such as a power button, a shooting 
mode selection button, a shooting condition input button, and a release button (which are 
1 5 not shown). 

The primary characteristics of the electronic camera 1 2 of the present embodiment 
are functions of the MPU 40 and the image processing part 52 in a multi-shooting mode 
which will be described later, and functions of the remaining parts are substantially the 
same as those of conventional electronic cameras. 
20 <Description of Operations of the Present Embodiment> 

Fig. 2 is a flow chart showing operations of the electronic camera 12 of the present 
embodiment. Operations of the electronic camera 12 will be hereinafter described 
according to step numbers shown in the drawing. 
[Step SI] 

25 When the power button of the electronic camera 12 is pressed, power-on 



processing is performed. Thereafter, the user operates the buttons on the operating part 
44 to set a shooting mode and so on. 
[Step S2] 

The MPU 40 determines whether a multi-shooting mode is set or not. In the 
5 multi-shooting mode, the process proceeds to step S4. In other shooting modes (such as a 
single shooting mode), the process proceeds to step S3. 
[Step S3] 

Shooting is performed in the set shooting mode. This is a known operation, 
therefore, a description thereon will be omitted here. 
1 0 [Step S4] 

The MPU 40 stands by until the release button is fully pressed. When the button is 
fully pressed, the process proceeds to step S5. 
[Step S51 

The MPU 40 drives the CCD 20 with an electronic shutter in synchronism with the 
1 5 full press on the release button to start continuous shooting at a preset frame rate (e.g., 1 5 
fps) (details of this operation are well known and will not therefore be described.). Image 
data of each of frames thus generated (frame image data) is captured into the image-data 
memory 56 through the analog-to-digital conversion part 28. 
[Step S6] 

20 The continuous shooting at step S5 is performed until the fully pressed release 

button is released. With the release, the process proceeds to step S7. Even before the 
release from the full press on the release button, the continuous shooting is terminated if 
the amount of the captured image data reaches the capacity of the image-data memory 56. 
[Step S7] 

25 The MPU 40 terminates the continuous shooting in synchronism with the release 
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from the full press on the release button. Then, the image processing part 52 performs 
image processing such as white balance adjustment, gamma correction, and color 
interpolation processing on the entire frame image data generated by the continuous 
shooting. Thereafter, image data in each frame is captured into the image-data memory 
5 56 again. The process then proceeds to step S8. 
[Step S8] 

The MPU 40 reads a user's setting to determine in which of the following two 
manners frame image data is extracted for a composite image. In a difference reflecting 
extraction, the process proceeds to step SI 1. In a uniform interval extraction, the process 
10 proceeds to step S9. In the difference reflecting extraction, the smaller differences 
between frames (to be described later) are, the longer image extracting inten/als are. In the 
uniform interv/al extraction, extraction is performed at such intervals that intervals at which 
each frame image of extracted image data has been shot become substantially uniform. 
[Step S9] 

1 5 The MPU 40 determines the number of the frames generated by the continuous 

shooting at step S5 (hereinafter referred to as number of shot frames). The user can 
increase or decrease the number of shot frames as he or she wishes by operating the 
release button. 

The MPU 40 determines image extracting intervals according to the number of shot 
20 frames and the number of arranged frames which has been set in advance through a user's 
operation or the like. The number of arrariged frames used herein refers to the number of 
frames that are arranged in one composite image in the multi-shooting mode. The image 
extracting intervals refers to intervals at which the extraction is performed for all of the 
frames of image data generated by continuous shooting to extract the frames of image data 
25 to be used for a composite image. For example, in a case where every fourth frame is 



extracted, the image extracting intervals are three. 

For example, the image extracting intervals may be set to values which are 
obtained by subtracting one from a value obtained by dividing the number of shot frames 
by the number of arranged frames. When it is necessary to extract the image data of the 
5 first and last shot frames, for example, the image extracting intervals may be set to values 
which are obtained by subtracting one from a value obtained by dividing (the number of 
shot frames minus one) by (the number of arranged frahies minus one). The process then 
proceeds to step SI 0. 
[Steps 10] 

1 0 The MPU 40 extracts frame image data according to the image extracting intervals. 

For example, assume that the image data of the first and last shot frames is to be extracted 
where the number of shot frames is 61 and the number of arranged frames is 16. Then, 
the extracting intervals will be three so that the first, fifth, ninth, ... and sixty-first frames 
are required to be extracted. The process then proceeds to step SI 4. 

15 [Step SI 1] 

The MPU 40 selects frames for which differences between frame images are to be 
calculated according to the number of shot frames and the number of arranged frames. A 
difference between frame images is a parameter representing the amount of a variation in 
an object between frame images and will be calculated at the next step SI 2. 

20 The present embodiment describes an example that image data of all of frames 

excluding the first frame is selected when a value obtained by dividing the number of shot 
frames by the number of arranged frames is smaller than a predetermined value. When the 
value thus obtained is equal to or greater than the predetermined value, image data of all of 
the frames other than the first frame is decimated at an interval according to the obtained 

25 value. Then, image data of remaining frames is selected. For example, when the obtained 
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value is twice the predetermined value, every other frame is selected. When the obtained 
value is three times the predetermined value, every third frame is selected. Note that the 
number of frames of image data thus selected is at least equal to the number of arranged 
frames, and the shooting is performed at substantially uniform intervals. 
5 For example, in a case where it is determined to select every third frame, the image 

data of the first and fourth frames is compared with each other to obtain a difference 
therebetween that is associated with the fourth frame. Similarly, the Image data of the 
fourth and seventh frames is compared with each other to obtain a difference therebetween 
that is associated with the seventh frame. That is. Image data of frames used for the 

10 comparison to calculate the difference is image data of frames, among the selected image 
data, which has been shot immediately prior to the frame for the subject of the calculation 
or the image data of the first frame. 

The difference between frame images may be obtained for the image data of all of 
the frames excluding the first frame regardless of the number of shot frames and the 

15 number of frames arranged In one composite Image. The process then proceeds to step 
S12. 

[Step SI 2] 

The MPU 40 calculates the difference between frame images for the frame image 
data selected at step SI 1 . Specifically, the pixel value of each pixel of frame image data as 

20 subject of the comparison is subtracted from the pixel value of each pixel of frame Image 
data for which a difference between frame Images is calculated. One frame of image data 
thus generated is defined as difference Image data. In the present embodiment, since 
color interpolation is performed at step S7, the pixel value Is the digital data of the color 
component including the greatest amount of luminance information among digital data of 

25 respective color components. That is, the speed of the processing is increased by not 
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processing the digital data of unneeded color components. 

The sign of each pixel value of the difference image data is reversed if it has a 
negative value. Then, the sum of all of the pixel values of the difference image data is 
obtained as a difference between frame images. The process thereafter proceeds to step 
5 S13. 

Alternatively, digital data of a plurality of color components of each pixel may be 
processed. For example, difference image data is generated by subtracting the pixel values 
of first and second color components of each pixel of single frame image data to be used 
for comparison from the pixel values of the first and second color components of each pixel 

1 0 of single frame image data for which a difference between frame images is to be calculated, 
respectively. Then, any of the pixel values of the first and second color components having 
a negative value is subjected to sign-reversal. The sum of all pixel values of the first and 
second color components of the difference image data may be used as a difference between 
frame images. 

15 [Step SI 3] 

The MPU 40 extracts image data corresponding to the number of arranged frames 
from the image data selected at step SI 1 in ascending order of differences between frame 
images. The present embodiment, however, describes an example that the extraction is 
performed such that the data extracted include data of the first frame (difference between 

20 frame images is not calculated for the first frame). 

Alternatively, it may be configured that the image data of the first and last shot 
frames is always extracted regardless of whether the frames are subjects for the calculation 
of the difference between frame images. Further, the extraction may be performed only on 
the frame image data selected at step SI 1 without extracting the first frame. 

25 The process thereafter proceeds to step SI 4. 



[Step SI 4] 

The MPU 40 arranges the frame image data extracted (at step SI 0 or SI 3) on the 
image-data memory 56 to create image data of a composite image (composite image data). 
The arrangement is made in an order in accordance with the times at which they are shot, 
5 and the earlier the time, the earlier the order. For example, the frame images are arranged 
in the order, starting from a first shot frame, in a top left position which is followed by top 
right, middle left, middle right, bottom left, and bottom right positions. Fig. 3 is an 
illustration showing an example of a composite image created in such a manner. 

For example, assume that the size of a single frame image in a composite image is 
10 vertical 240 pixels x horizontal 320 pixels and that the number of arranged frames is 16. 
Then, the size of the composite image will be vertical 960 pixels x horizontal 1280 pixels. 
When the size of the composite image is smaller than a predetermined size (e.g., vertical 
1200 pixels X horizontal 1600 pixels), the MPU 40 instructs the image processing part 52 to 
perform interpolation processing on the composite image data to enlarge it to the 
1 5 predetermined size. 

After converting the composite image data into that of the predetermined size, the 
image processing part 52 further performs processings such as color conversion, color 
correction, contour enhancement, and image compression. Then, the image processing 
part 52 records the compressed composite image data in the memory card 68 through the 
20 card interface 64. The recording may include recording of supplementary information 
indicating by how many seconds the shooting time of each frame image has delayed from a 
time t = 0 at which the first frame has been shot. The MPU 40 deletes frame image data 
which have not been extracted from the image-data memory 56. 

Operations of the electronic camera of the present embodiment are as described 

25 above. 



<Advantages of the Embodiment> 

The multi-shooting mode of the present embodiment includes two functions, i.e., 
uniform interval extraction and difference reflecting extraction, and image data of a plurality 
of frames is generated by continuous shooting while the release button is fully pressed by a 
5 user. 

While the uniform interval extraction is set, image data of frame images to be 
arranged is extracted from the generated frame image data at such intervals that intervals 
at which the frame images have been shot become uniform (step SIO). Therefore, the first 
frame image of the composite image is the image shot at the instant when the release 

1 0 button is fully pressed by the user. Similarly, the last frame image of the composite image 
is the image shot at the instant when the full press on the release button is released. As a 
result, the total shooting tinie can be arbitrarily set through an operation of the user even 
with a fixed frame rate of the CCD 20. 

Specifically, when a swing of a golf club is shot, the total shooting time can be 

1 5 adjusted to the time from the start to end of the swing. This solves the problem that a 
generated composite image includes only frame images shot up to a point halfway the 
swing because the shooting terminates before the swing ends. Similarly, it is possible to 
solve the problem that a generated composite image includes unnecessary frame images 
taken after the swing ends because the swing terminates before the shooting ends. 

20 While the difference reflecting extraction is set, selection is performed such that the 

number of frame images whose data is selected is equal to or more than the number of 
arranged frames, and the intervals at which frame images have been shot become 
substantially uniform (step SI 1). Differences between frame images are obtained for the 
selected frame image data, and the frame images are selected in ascending order of the 

25 obtained differences (steps SI 2 and SI 3). This solves the problem that a generated 
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composite image includes unnecessary frame images which are substantially the same as 
their preceding and succeeding images. As a result, as shown in Fig. 3, it is able to create 
a composite image which clearly captures motions of the object. 

If frame image data extraction is performed such that the first and last shot images 
5 are extracted without fail, the user can determine the total shooting time through a release 
button operation in the same way as in the uniform interval extraction. 
<Supplementary Notes for Present Embodiment> 

[1] In the present embodiment, an example was described in which the sum of all 
pixel values of difference image data is obtained as a difference between frame images 

10 (step SI 2), The invention is not limited to such an embodiment. Pixels having absolute 
pixel values equal to or greater than a preset threshold may be counted among the 
difference image data, and the count value may be used as a difference between frame 
images. The count value represents the area of portions which show a change from the 
preceding frame image or a movement of the object. 

1 5 [2] An example was described in which data of frame images to be arranged is 

extracted from frame image data selected at step SI 1 as a subject for calculation of 
differences between frame images. The invention is not limited to such an embodiment. 
When there is frame image data having a great difference between frame images, frame 
image data preceding and succeeding thereto and not selected as an subject for calculation 

20 of the differences may be extracted and used for generation of a composite image. 

[3] An example was described in which the frame image data to be used for 
generation of a composite image is extracted using either uniform interval extraction or 
difference reflecting extraction. The invention is not limited to such an embodiment. For 
extraction of frame image data to be used for a composite image, for example, random 

25 extraction, starting time extraction, middle time extraction, ending time extraction, X-th 



power extraction, or the like may be made selectable depending on a user's purpose. 

In the random extraction data is extracted at random from all of the frame image 
data generated by continuous shooting. 

In the starting time extraction, for only a certain percentage of frame images shot 
5 at the start of shooting the extraction is performed at such intervals that intervals at which 
the frame images have been shot are shorter than intervals at which the rest of the frame 
images have been shot. The percentage may be determined by the user's input, for 
example. This way of extraction is advantageous when motions of the object at the 
beginning of shooting have greater importance. 
10 In the middle time extraction, for only a certain percentage of frame images shot at 

the middle of shooting the extraction is performed at such intervals that intervals at which 
the frame images have been shot are shorter than intervals at which the rest of the frame 
images have been shot. 

In the ending time extraction, for only a certain percentage of frame images shot at 
1 5 the end of shooting the extraction is performed at such intervals that intervals at which the 
frame images have been shot are shorter than intervals at which the rest of the frame 
images have been shot. 

The X-th power extraction is performed such that times at which extracted frame 
images have been shot will be values as a series of X-th powers (the value X is input by the 
20 user) at an instant when the object starts moving is zero (a starting point). 

For example, in case of shooting a rubber balloon which is expanding while being 
injected with a liquid at a constant flow rate, from the start of the injection or immediately 
prior to the start, the frame images are extracted such that times at which the frame images 
have been shot will be values as a series of third powers when the injection starting time is 
25 zero (a starting point). Specifically, where the injection starting time (the shooting time of 
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the first extracted frame) is t = 0, the extraction is performed such that the shooting time of 
the second extracted frame is t = 1 ; the shooting time of the third extracted frame is t = 8; 
the shooting time of the fourth extracted frame is t = 27; the shooting time of the fifth 
extracted frame is t = 64; and so on (the unit of the time t is determined according to the 
5 total shooting time, the number of shot frames, and the number of arranged frames). The 
reason is that it is assumed that the diameter of the rubber balloon increases in proportion 
to the one-third power of injecting time because the volume of the diameter of the rubber 
balloon increases in proportion to injecting time. Thus, increases in the diameter of the 
rubber balloon between the extracted frame images can be shown at uniform intervals. 

1 0 For example, assume that an object dropping at a predetermined acceleration is 

shot with a sufficient distance from the instant when it starts dropping or immediately 
before the instant. Then, the extraction of frame images is performed such that their 
shooting times constitute a series of square roots. Specifically, where the drop starting 
time (the shooting time of the first extracted frame) is t = 0, the extraction is performed 

1 5 such that the shooting time of the second extracted frame is t = 1 ; the shooting time of the 
third extracted frame is t = V2 ; the shooting time of the fourth extracted frame is t = Vs ; 
the shooting time of the fifth extracted frame is t = 2; and so on. Thus, the amounts of 
movements between the extracted frame images can be shown at uniform intervals. 

A way of extraction may be selected after checking motions of an object after the 

20 completion of the shooting. Alternatively, the selection may be done before the shooting. 

[4] An example was described in which one item of composite image data is created 
from extracted frame image data and the created composite image data is recorded. The 
invention is not limited to such an embodiment. Each item of extracted frame image data 
may be separately recorded without creating composite image data. That is, the invention 

25 may be applied to continuous shooting modes other than the multi-shooting mode, and 
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advantages similar to those described above can be also achieved. 

[5] At steps S4 to S6, an example was described in which continuous shooting is 
performed from the full press on the release button to the release from the full press. The 
invention is not limited to such an embodiment. For example, continuous shooting may be 
5 started in synchronism with a full press on the release button and terminated in 
synchronism with another full press thereon after the full press is once released. 
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